On the sign problem in dense QCD 
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We investigate the Euclidean path integral formulation of QCD at finite baryon density and 
temperature. We show that the partition function Z can be written as a difference between two 
sums Z+ and Z-, each of which defines a partition function with positive weights. We call the sign 
problem severe if the ratio Z- / Z+ is nonzero in the infinite volume limit. This occurs only if, and 
generically always if, the associated free energy densities F± are equal in this limit. We present 
strong evidence here that the sign problem is severe at almost all points in the phase diagram, with 
the exception of special cases like exactly zero chemical potential (ordinary QCD), which requires a 
particular order of limits. Part of our reasoning is based on the analyticity of free energy densities 
within their open phase regions. Finally, we describe a Monte Carlo technique to simulate finite- 
density QCD in regions where Z- / Z+ is small. 
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1. Introduction 

The Monte Carlo method, which relies on importance 
sampling, plays a central role in our ability to investi- 
gate the nonperturbative properties of strongly coupled 
quantum held theories. However, many models have a 
so-called sign problem: we do not know how to express 
their Euclidean functional integral as a sum over posi- 
tive quantities, which have a probability interpretation; 
see, for instance, [l|, 0, Q. This problem arises in dense 
QCD, chiral gauge theories and many models of elec- 
tronic systems. At chemical potentials much larger than 
A-QCD, dense QCD exhibits a Fermi surface, and the ef- 
fective field theory near the surface has desirable posi- 
tivity properties [j, [E IE 0] j however we do not rely on 
those particular properties here. For an alternative ap- 
proach to the sign problem using stochastic quantization 
and complex dynamics, see [|[. 

The partition function of a grand canonical ensemble 
is real, strictly positive and can be expressed as a sum 
over positive terms (since the Hamiltonian TL, the particle 
number operator N and all their real linear combinations 
are Hermitian): 



Z = Z{p,p) = Tc(exp(-P(H-iiN))) 



(1) 



Despite these desirable positivity properties, it is difficult 
to deal with Z directly in this form due to the vastness 
of Hilbert space, over which the trace is evaluated. It 
is advantageous to rewrite Z as a Euclidean functional 
integral, which sums over classical field configurations 
rather than quantum states (which are wave functionals 
thereof). In the case of dense QCD (Yang-Mills with 
quarks and chemical potential): 



Z = 



J VA detM(A) e 



S G (A) 



(2) 



where S G (A; /3) = ^ dx 4 f d 3 xC§(A) is the thermal 
Euclidean gauge action. The quark matrix is M(A) = 
Ip(A) — m — ;U74, with anti-Hermitian covariant derivative 
Jp = 7 P (c^ — igA^t' 1 ') and Hermitian group generators 
t a and (Euclidean) 7-matrices. For real nonzero chemi- 
cal potential fx, the eigenvalues of M are complex without 
grouping into subsets of real and positive products, and 
hence det M(A) is generally complex. The infamous sign 
problem arises because importance sampling relies on a 
positive definite (in particular, real) measure. 

2. Two ensembles Z± 

Nevertheless, from (TTJ) the partition function Z is real 
and can be expressed in a way that makes this manifest. 
Sg(A) is real and the integral with (Haar) measure VA 
is to be interpreted as a real Riemannian sum: 



Z = Re Z = J VA Re (det M (A) e 



-Sg(A) 



J VA (RedetM(A)) e 



S G (A) 



(3) 
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Similar arguments have been made in Q. 

In the case of dense QCD there is a simple pair- 
ing A <-> A' of gauge held configurations which explic- 
itly shows the cancellation of all imaginary contribu- 
tions to ([21) [nj: Since action and measure are gauge- 
invariant, assume Ai{x) = (one could choose any com- 
ponent of A^(x) to be zero; the proof proceeds with 
only slight modification) for the given gauge configu- 
ration Afj, = A^t a (or first transform to that gauge), 
and define A'^ (x, x 4 ) = A* (-x, x 4 ) , i.e. A^ (x, x 4 ) t a = 
A" (— x, x 4 ) (t a )* . Direct examination of M(A) then 
shows that its spectrum {A^} is mapped to its com- 
plex conjugate {A,*} as A — > A 1 (the eigenspinors ipi 
of M(A) are mapped to ip[ (x, x 4 ) = 7572^ (— x, x 4 )), 
so that det M(A') = (detM(A))*. Since for the gauge 
actions Sq(A) = Sg(A') and for the Haar measures 
VA = VA', imaginary contributions in ^ cancel pair- 
wise between A and A', leading to ([3]) in a more explicit 
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manner. Note that the above mapping essentially cor- 
responds to a parity transformation (x, x 4 ) — > (—x,x 4 ) 
of the fields followed by charge conjugation (complex 
conjugation with 72 for fermions). In the lattice for- 
mulation of gauge theories, the transformation U — ► U* 
that maps every gauge link to its complex conjugate al- 
ready effects a pairing of gauge configurations satisfying 
det M(U*) = (det M(U))* and S G (U*) = S G (U). A re- 
lated mechanism works for chiral gauge theories as well 
B 

Now, in order to deal with positive quantities, denote 
the set of configurations A for which Re det M(A) is pos- 
itive as {+}, and similarly for {— }. Then, from (J3j> , 

Z = |RedetM| e - SG(A) - ^ |Redet M\e~ SG ^ 
{+} {-} 
= Z + - Z_ . (4) 

Note, here 




FIG. 1: Two possibilities for the sets {+} (grey) and { — } 
(white), {left) One (here the {+} set) or both might not 
be connected; in this case, Hamiltonian evolution will never 
sample the whole {+} set due to infinite potential barriers 
between the grey and white patches, although molecular dy- 
namics algorithms with finite time step might not see these 
barriers, (right) Each of the two sets {±} is connected, so 
sampling of each is possible in principle with molecular dy- 
namics (ergodicity is here assumed). 



Z±=Y1 |RedetM|e- So(A;/3) (5) 
{±} 

are themselves partition functions with positive weights. 
So, an analogy with the canonical ensemble in statisti- 
cal mechanics (at unit temperature) becomes apparent 
if the Euclidean action S G (A) is interpreted as part of 
the potential energy of a Hamiltonian H(A) describing a 
fictitious 4+1 dimensional theory (as in molecular dy- 
namics methods). Note, H(A) should not be confused 
with the Hamiltonian TL of the original 3 + 1 dimensional 
system in ([1]). 

The fermion determinant in ([5]) can be exponentiated 
to become a non-local term in this effective Hamilto- 
nian: H(A) = V{A) + H kia with V(A) = S G (A) - 
ln|RedetM(A)|. This term is singular (V(A) = +00) 
when Re det M passes through zero, which means that 
a {+} configuration will not evolve into a {— } under 
Hamiltonian evolution: there is an infinite potential bar- 
rier separating the Z + and Z_ ensembles ([3]) from each 
other. Therefore, one can define Z± separately as inde- 
pendent microcanonical ensembles (using the equivalence 
of canonical and microcanonical formulations as in molec- 
ular dynamics algorithms; see also next paragraph); and, 
if {+} as well as {— } is each a connected set (except, 
possibly, for a subset of measure zero), each ensemble has 
its own (presumably ergodic) flow (Fig. [TJ right panel). 
That is, modulo this exceptional disconnected measure- 
zero subset of configurations, typical configurations con- 
tributing to Z + could in principle then be generated by 
starting with an arbitrary {+} configuration (with ap- 
propriate energy; see below) and evolving it using 
the effective Hamiltonian equations of motion for A; the 
same is true for Z_ . Whether this procedure for sampling 
of Z± would work in practice on computers depends on 
the sizes of features in the potential V(A) relative to the 
time-step size: if the size of the time steps used in the 



algorithm is not small enough, the infinite potential bar- 
riers might not be seen and the algorithm might jump 
from {+} over to { — } or over to another disconnected 
subset of {+} (Fig.EEJ left). 

Z± can be treated similarly to ensembles in statistical 
mechanics: First define an "entropy" Yl±(E) as the log- 
arithm of the number of ± configurations A with action 
("energy") E = S G - In |Redet M\, Then both partition 
functions 

Z ± =JdEe- E +^^ (6) 

can be expanded about their respective saddlepoints at 
energies E± given by the condition 



The saddlepoint energies E+ and E*_ are not necessarily 
equal, and, importantly, there is no reason to expect the 
saddlepoint values of the exponent to be the same, mean- 
ing that, generically, one of Z± ss exp (—E± + T*±(E±)) 
could be exponentially larger than the other. If there 
is a dominant term it must be Z + since Z is positive. 
If Z + is exponentially dominant the situation improves 
dramatically: it, and therefore practically Z, can be eval- 
uated using importance sampling. In this circumstance 
the sign problem is not severe. Note that dominance 
by Z + would not imply the absence of complex phases in 
the determinant, but only the dominance of contributions 
with positive real part. 

In the following we will make more specific arguments 
about the relative sizes of Z + and Z_ , also paying closer 
attention to issues of volume dependence. Although some 
of our arguments are in principle also capable of support- 
ing exponential discrepancy between Z + and we find, 
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in all specific cases considered and through one more gen- 
eral argument, strong evidence that in all open regions 
of the QCD phase diagram they become equal at infi- 
nite volume, or are at least not exponentially separated, 
thereby constituting a severe sign problem in (at least) 
all of those open regions. This is in contrast to the expec- 
tations based on the saddlepoint approximation in (JT])- 

3. Free energies and sign problem 

Without invoking the saddlepoint method, we can de- 
fine free energy densities F± via 1 

Z ± =c^(-VF ± (^ /?)) , (8) 

where V is the Euclidean 4-volume in which the theory 
lives (or the physical lattice volume). In the previous 
version of this paper [12j , we conjectured that in the large 
volume limit the generic situation is 

F+ < F_ , 

which would imply that Z + exponentially dominates Z_ 
at large volume V. The alternative is that they are ex- 
actly equal: F + = F- (recall Z > 0, so F + > F_ is not 
possible). It is in this case that the sign problem can be 
severe (in the sense defined in the abstract): the ratio 
of Z— to Z + then generically approaches some nonzero 
constant (possibly 1) at large volume 1 . In the thermo- 
dynamic limit, free energy densities are analytic except 
at phase boundaries; thus, if F + = F_ in some open re- 
gion, they must be equal everywhere within the whole 
intersection of the respective phase regions of Z+ and 
Z_ (i.e., except, perhaps, at or across phase boundaries 
where free energy densities might not be analytic). At 
fx = we know Z_ = 0, i.e. F_ = +oo, and Z + = Z > 0, 
so it seemed natural to us to assume that there would 
be an open region of small /x, extending into the (/i, /?) 
plane, where F + < F_. 

It turns out that this last assumption is most likely 
incorrect. Results which we will discuss below strongly 



1 F± (fj,, (3) are the densities corresponding to the extensive part 
of the free energies, formally defined as follows: partition func- 
tions Z and Z± are finite only for finite volumes V, and the 
volume dependence of the associated densities /, f±, defined 
via Z(fi, /3, V) = exp (— Vf(/i, /3, V)), vanishes only in the ther- 
modynamic limit: F(fi,(3) = liray^ oc f(fi,/3,V). Nevertheless, 
for finite V, at which simulations are done, the volume depen- 
dence f(V) = F + /(V) can be important and subtle: since 
zero-density QCD has positive measure, F— (fj, = 0, 0) = +oo (or 
is ill-defined), but for any chosen (not too small) constant c < oo 
there seem to be infinite sequences fi n — > 0, V n — > oo such that 
f—((j, n ,f3, V„) = c for all n; so the order of limits is important. 
Also, if the volume-dependent pieces f± (V) vanish more slowly 
than l/V in the thermodynamic limit, one can, contrary to naive 
expectation, have Z—/Z-\. —* in the case F+ = _F_, thereby un- 
expectedly alleviating the severity of the sign problem (but in 
the case < F- one always has Z—/Z+ — > 0, i.e. no severe 
sign problem). 



suggest that even at arbitrarily small (but nonzero) /i, Z+ 
does not exponentially dominate Z-. That is, F + = in- 
exactly, even at small nonzero \x. The order of limits 
is important 1 : taking V to infinity for fixed nonzero \i 
(no matter how small) leads to large sign fluctuations. 
Ordinary QCD is only obtained by taking /j, — > before 
taking V — > oo. Strangely, the case [i = we are most 
familiar with is the atypical one! 

Although the logic based on (piecewise) analyticity of 
F± inside their respective phase regions is correct, what 
we originally [l2| conjectured to be "exceptional" regions 
in the phase diagram are the typical ones, and vice versa. 
There seems to be no open region at small \x where Z + 
dominates, rather only the axis where /i is exactly zero 2 . 

In fact, one can probably go further and argue that (in 
the large volume limit) F + — almost everywhere in 
the QCD phase diagram, meaning that the sign problem 
is, in a sense, maximally severe. The analytic proper- 
ties of F± are useful in deducing this result, since one 
only has to find an open subregion in each phase of Z+ 
and Z- where the sign problem is severe - see Fig. [5] 
It might not be enough, though, to find one such open 
region in each phase of Z (see the examples of hadronic, 
quark-gluon plasma and color superconductor phases in 
Section 4) to argue in this way for (or against) a severe 
sign problem in the whole respective phase of Z since F + 
and F_ might have more (or at least different) phases 
and phase boundaries than Z (see esp. discussion of the 
hadronic phase in the following section). Note, in the fig- 
ure we have allowed for the possibility of an exotic dense 
nuclear phase in region D; whether such a phase exists is 
speculative. 

Besides applying the above reasoning based on analyt- 
icity properties of the free energy densities F± to specific 
regions of the QCD phase diagram and finding a severe 
sign problem - in the sense defined above - in each re- 
gion (as we will do in Section 4), there exists one other 
general argument that the sign problem might be strong 
(in a possibly somewhat different sense, namely as mea- 
sured by the volume dependence of sign or phase averages 
in some appropriate or chosen ensembles) almost every- 
where on the phase diagram: each such sign or phase 
average can be written as the ratio of two (positive) par- 
tition functions, which at finite volume V have associated 
free energy densities, e.g. 

jT>ARedetMe- Sc _ Z 
(sgn)|R c dct| - j VA \ RedetM \ e S G ~ 

e- VF 



2 In [131 , the authors find a particular order of limits which results 
in no sign problem for T exactly equal to zero and small fi (fi < 
However, this again is not an open region in the phase 
diagram to which analyticity arguments would apply, and it also 
depends on the order of limits. 
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T 

B quark-gluon plasma 



c critical endpoint 




FIG. 2: Schematic phase diagram of QCD. We argue that 
dense QCD has a severe sign problem almost everywhere in 
the (/i, T)-plane. Since within a particular intersection of 
a phase of and a phase of Z~ the free energy densities 
F± are both analytic, we only have to argue that F+ = F_ 
in some open patch of that intersection to show equality in 
the entire phase intersection. The phases of the theory Z, 
shown here in the diagram, might not or might only partially 
coincide with the phases of Z+ and Z- (see esp. discussion 
of hadronic phase in Section 4). For realistic quark masses, 
there probably is a smooth crossover between phases A and 
B, implying analyticity of the free energy density of Z across 
this boundary. Whether a separate phase D of exotic nuclear 
matter exists is speculative. 



Since the average sign is no greater than 1, we have 
F > F\\ necessarily, and the case F — Fn seems to 
be the exception, especially if the physics described by 
the two partition functions (or, equivalently, by the two 
free energy densities) is different. In this line of reason- 
ing, it is often argued that the sign problem is strong, 
since sign averages vanish exponentially fast in the space 
(or lattice) volume V , as soon as there exist configura- 
tions A on which the two partition functions disagree; 
i.e., in the example ([5]), if there exist configurations with 
RedetM(A) ^ |RedetM(A)|, meaning Z_ ^ 0. Similar 
kinds of reasoning can be applied to other sign and phase 
averages, like the commonly considered (e' iarg ( M )) dct 
or ( e 2»arg(M)/JV F ) |det| Q ( with Np the num b e r of 

quark flavors), etc. Note that, in our notation the 
specific average ((9|) equals (Z + — ZJ) / (Z + + ZJ), sug- 
gesting that Z-/Z+ approaches 1 (for large volumes V) 
at most points in the phase diagram, thereby supporting 
the claim from the previous paragraph about the severity 
of the sign problem in dense QCD. 



(Then, for a theory with Np flavors, the full fermion de- 
terminant detM = detM Np has phase angle Np9.) In 
[lH it is shown, using chiral perturbation theory, that in 
the low temperature and density region (lower left cor- 
ner of region A in the diagram of Fig. [5]) the distribution 
p(9) governing the angle (viewed as a non-compact vari- 
able 9 £ (— oo, +oo)) is Gaussian and has a width which 
grows as ^/V. 3 This means that in the thermodynamic 
limit V — ► oo both signs of Re detM (i.e., both Z + and 
ZJ) contribute significantly to Z, even in such a way 
that Z-jZ+ — > 1 as V — > oo in this patch of region A. 
To obtain ordinary (zero density) QCD, one must take 
fi to zero before taking V to infinity 1 . Our analyticity 
arguments from above then suggest that there is a severe 
sign problem in the (open) intersection of the two phases 
of Z + and Z_ which both contain the patch of low /i 
and T. Note that this intersection is most likely smaller 
than the whole phase region A: both Z + and Z_ seem to 
have a phase transition ("onset of pion condensation") 
at (i around m^/2 (half the pion mass) in the tempera- 
ture range of phase A; the phase transition cancels out 
in the difference Z = Z + — Z-. For T = this phase 
transition at fj, = m^/2 is known as the Silver Blaze tran- 
sition [H|,[l6|], and at T > in the hadronic phase there is 
growing numerical and theoretical [17| evidence for a very 
similar transition in /i. (Note, the sign problem seems to 
be even more severe to the right of this transition line.) 
If the finite temperature, low density phase transition 
(dashed line in Fig. ^ is a crossover in the theory Z, 
as is currently believed to be the case for realistic quark 
masses, there might also only be a smooth crossover for 
the Z± ensembles across this line, and this would suggest 
that right across the crossover there is also a severe sign 
problem in an open subset of the quark-gluon plasma 
phase B. 

Next, examining this phase B separately, consider the 
following two partition functions. Let Zn f describe 
dense QCD with an even number of flavors Np, and let 
Z|jv f | describe a model with Np/2 flavors with chemi- 
cal potential /i and Np/2 flavors with opposite potential 
—fi. (All quarks are assumed to be degenerate.) In Z\ Np \ 
the phase factors cancel and only the magnitude of the 
determinant appears in the functional integral. Clearly, 
from the path integral representation, 

Zn f < Z\ Np \ ■ 



4. Phase diagram 

The most powerful techniques we are aware of are those 
of Splittorff and Verbaarschot Let 9 = 9(A) be 

the phase of the determinant of the quark matrix M — 
M(A) of a single flavor: 



2i8 



detM 
detM* 



(10) 



3 Note, these results are obtained in IT3II by considering phase dis- 
tributions p(8) computed with respect to the phase-quenched 
measure \ det M(fi)\, where M(/i) is the fermion matrix with 
quark chemical potential ^t; this phase-quenched measure is iden- 
tical to the measure of quarks coupled to an isospin chemical 
potential fij = fi. Nevertheless, since here and in I 111 p(9) is the 
distribution of the phase of the determinant of the fermion ma- 
trix with quark chemical potential, our results (and the results 
in [l3l |'l do apply to dense QCD with quark chemical potential, 
as claimed. 
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Now write 



Z 



Nr. 



'\N F \ 



cxp (-VF Nf ) 
exp(-VF\ Nr \) 



(11) 



Unless the two free energy densities in (fTTj) are exactly 
equal, which would be peculiar since the two models have 
very different physics, this ratio will be zero in the ther- 
modynamic limit V — > oo . Equality of Fn f and F\n f \ 
would require that the free energy of QCD be a function 
only of even powers of individual chemical potentials for 
each flavor. In the quark-gluon plasma phase (large tem- 
perature and small 0fi; upper left corner of region B in 
Fig. [2]) one can com put e the free energy density in per- 
turbation theory [l3lll8|] , and indeed terms linear in indi- 
vidual chemical potentials (e.g., ~ (X)/ 1 /) 2 ) are found, 
so the ratio (JTTJ) is zero at infinite volume. We expect 
this to be the case generically, on physical grounds. 

Now, eqn. (jlip can be rewritten using the distribution 
function p(0) (computed in the phase quenched theory) 



Z\ 



N F \ 



= J dJ9 P {6) cos(N F 8) 



(12) 



from which it is clear that the vanishing of this ratio 
implies either severe sign oscillations in Z^ F (i.e. the dis- 
tribution p(6) is flat such that both signs of cos(NpO) ~ 
Re det M contribute significantly to Zn f = Z + — Z- , 
even implying Z_ / Z + — > 1), or that p(9) becomes arbi- 
trarily peaked at values 9 where cos(NfO) vanishes. This 
latter possibility requires that det M becomes purely 
imaginary for essentially all gauge backgrounds, which 
seems implausible. 

Thus, our analyticity reasoning, combined with other 
inputs, provides strong evidence for a severe sign prob- 
lem in the part p < of the hadronic phase A (small 
p, T; extended to all of this subregion of A by analyt- 
icity) and in the small p part of the high temperature 
phase B (extendible by analyticity to other regions as 
long as Z± are both analytic). Note, in phase B the or- 
der of limits seems to be important as well: if, at fixed 
volume V, the temperature is sent to infinity T — ► +oo, 
the sign problem seems to become arbitrarily weak. This 
is supported by numerical lattice simulations and by the 
theoretical observation that in the infinite temperature 
limit (in lattice regularization) only the trivial plaque- 
tte configuration contributes with significant Boltzmann 
weight [191 ]. 

Finally, we consider the low temperature, high density 
phase (region C in Fig. which is known to exhibit color 
superconductivity [20. l2ll |22[ l23l. l2~i| . This phase has a 
low energy effective field theory description (of modes 
near the Fermi surface) which has good positivity prop- 
erties 0, H, H, Q- However, that does not imply that 
the sign problem is absent in the usual Euclidean path 
integral In fact, if there were no severe sign prob- 
lem - i.e., Z+ would dominate Z_ exponentially at large 



apply to this phase. Such inequalities forbid the spon- 
taneous breaking of vector symmetries such as baryon 
number, which is in contradiction to explicit calculations 
in the dense phase This suggests that the part of 
the high density (CFL) phase where those calculations 
are applicable (large p, small T/p), again extended to 
the common analyticity region of Z + and Z_ , also has a 
severe sign problem. 

Since the very existence of a separate exotic nuclear 
phase (region D in Fig. ^ is speculative, what we can in- 
fer about it is very limited. Two comments are perhaps 
in order: (1) if the phase D is not separated by a phase 
boundary in the Z± ensembles from the regions A, B or 
C (i.e., if there is only a smooth crossover), then analyt- 
icity would suggest a severe sign problem there as well. 
(2) unless the free energy in region D is independent of 
the signs of the individual chemical potentials for each 
flavor (i.e., a function only of even powers of the At/'s), 
then the argument we used for region B would also apply, 
indicating a severe sign problem. 

5. Degrees of severity of the sign problem 

In this paper we have defined the sign problem as se- 
vere whenever the ratio Z_ / Z + is nonzero in the ther- 
modynamic limit. The general argument presented at 
the end of Section 3 and the specific cases considered in 
the previous section suggest that this may be the case 
in almost the entire phase diagram. Note, however, that 
the precise value of Z_ / Z + at infinite volume also de- 
pends on the subleading (in volume) behavior of the free 
energy densities 1 . Some may prefer to call the sign prob- 
lem severe only when Z-/Z+ — > 1 as V — > oo. It is possi- 
ble that regions exist where, by this latter criterion, the 
problem is not severe: that is, where Z + ^> Z_ at large 
volume. One candidate region might be at low density 
and zero temperature (p < and T — > as V — * oo 

in a certain order of limits), based on analytical results 

in mug. 

Another region with relatively mild sign problem might 
be around the high temperature phase transition line ex- 
tending from (T c , p = 0) to p > (dashed line in Fig. J2J, 
based on lattice results in [3l|, [H, [H, [H, [H, [H, [33, [H, 
[39i | . or around the critical point itself. The fact that the 
Taylor expansion with coefficients com put ed at p, = 
[34 [35j or at imaginary p [H, H3, l38l l39j| agrees with 
results from multi-parameter reweighting at nonzero p 
[3TI . l32l [33l | in this region might suggest that the sign 
problem could be relatively mild there, at least for the 
lattice volumes considered. The three methods start to 
disagree at large p, > 1.3 T c and do so significantly in the 
region near the QCD critical point [ifl EH [42l| . 

Let us consider the (multi-parameter) reweighting 
method explicitly. In this method one computes 



Z(p,P) 



e" s G(/3) det M{p) \ 
e-So(M det M(p )/ Mo) 



(13) 



volume - QCD inequalities 



29, 30] would 



using configurations generated from the (po,Po) ensem- 
ble (Re po = to enable importance sampling) . It is 
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assumed that these configurations have significant "over- 
lap" with "typical" configurations of the (/x, /?) target 
model. The reweighting factor in angle brackets links 
the two ensembles. In case of a severe sign problem, 
the reweighting method faces the following challenges 
piil ]: (1) there are no "typical" configurations in the tar- 
get theory and there is no meaning to a good overlap 
between typical (//o>/?o) an d target configurations, (2) 
Z(jjl, (3) must be exponentially smaller than Z((j,q, Pq) and 
is therefore sensitive to error; equivalently, the reweight- 
ing factor, whose average itself is essential if one wants to 
compute an operator average (O) , must exhibit large sign 
fluctuations and numerically subtle cancellations [44L [451] . 
Thus, a relatively weak sign problem seems to be a nec- 
essary condition for reweighting methods to work. 

In the remainder of the paper we describe a method of 
simulating dense QCD (see also [45]) which will work in 
this case of a weak sign problem as well, with probably 
some advantages. 

6. A Monte Carlo method at fi ^ for Z + > Z_ 

At a point in the phase diagram where dominates 
Z- (either exponentially or just by a large enough fac- 
tor 4 ), we can evaluate any dense QCD correlator in good 
approximation using the new partition function 



Z+ + Z_ 



(14) 



instead of the original Z (cf. Q). By assumption, Z ncw 
differs from 

z = Z+- z_ 

by only a small amount (Z/Z ncw ~ 1) since Z + ^> Z_. 
Therefore, a lattice simulation employing the partition 
function Z ncw yields almost the same results as a simu- 
lation using Z, which is the desired partition function to 
simulate were it not for its sign problem. But now the 
functional integral 



Z ncw = J VA |RedetM(A)| e 



S G (A) 



(15) 



has positive weights and allows for importance sampling. 

To show more concretely how this change Z — > Z new 
enables importance sampling, we can reformulate in 



terms of expectation values of a real observable O(A): 

= i J VA detM(A) e~ SG{A) 0{A) . (16) 

From the representation as a trace, the expectation value 
is clearly real if O is Hermitian. Thus, by applying the 
same reasoning leading from ([2]) to ([3]) , one obtains 

(O) = i J VA (RedetM(A)) e~ SG ^ 0{A) . (17) 

For operators that are invariant under the above parity- 
charge conjugation operation, i.e. 0(A) — O(A'), this 
can also be justfied by the pairing arguments A <-> A' 
from Section 2. Then, following the equivalent of ((4]) to 
(fl"5|) . one arrives at 



(O) 



J VA |RedetM(A)| e 



-Sa(A) 



0{A) 



J VA |RedetM(A)| e - s °( A ) 



(18) 



in which the approximation is good assuming that Z + 
Z- and that O does not give exponentially large con- 
tributions on the {— } set of configurations A. (This 
last condition would be satisfied by, e.g., any polyno- 
mial in the gauge field.) (fl~8|) becomes an exact equation 
(without any overhead in numerical implementations) if 
the sign of Re det M in the numerator and denominator 
is taken into account (on the actually sampled config- 
urations). Then, the method is very similar to other 
reweighting methods: 

JVARedetM(A) O(A) 
[ ' JVARedetM(A) e- s o(A) ' W 

Conventional importance sampling with Monte Carlo 
techniques can be used to compute the expectation value 
of observables - the weights |Re dot M\e SatyA ^ , with which 
the sampling in (fl"9|) is done, are positive and can be in- 
terpreted as probabilities 5 . 

One might think that if the sign problem is mild (Z+ 
dominates) , almost any method will succeed equally well. 
This is not necessarily the case, as we now demonstrate 
with the example of |detM|. Note that an importance 



4 The method might also work at finite simulation volume V even 
if Z—/Z+ — » 1 in the thermodynamic limit, because subleading 
contributions to the free energy densities could render Z+ Z- 
for sufficiently small volumes V, 1 although in this case finite vol- 
ume effects might be so important that one might not actually 
be simulating the desired (infinite volume) system. On the other 
hand, rather than assessing the validity of a simulation by look- 
ing at finite-size effects in the ratio Z—/Z+, one should probably 
compare the correlation lengths of the physics inside the simu- 
lated volume to the lattice size itself, regarding a simulation as 
reliable if the latter is (much) larger than the former. 



Note, if one generates typical configurations using microcanon- 
ical methods — i.e., relying on ergodic Hamiltonian flow - it is 
necessary to modify the fermionic term in the effective Hamilto- 
nian to allow for {+} modes to evolve to {— } modes and vice 
versa. One possible modification is ln(|Redet M\ + e), where e is 
some small positive quantity. This smoothes out the singularity 
in the action at zero real part of det M and allows the ergodic 
flow to generate configurations of cither sign. Alternatively, one 
might rely on some intentional randomness (possibly due to finite 
step-size on a computer) in the generation of new configurations 
or on sufficiently big numerical inaccuracies; see, e.g., [46|. See 
also Fig. [1] (left). 
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sampling method has to begin with a positive measure. 
In the case of multi-parameter rcwcighting we obtain this 
positivity by taking Re/xo = 0. In the Z ncw method, we 
take |RedetM|. A third possibility is |detM|: in this 
method we sample from the measure e~ Sa ( A ' > \ det M(A)\ 
and treat the phase of det-M(A) as part of the observ- 
able [47],[48j]. However, this is not guaranteed to give a 
good approximation: it is possible that for typical config- 
urations | det M (A) | is very different from |Redet A/(A)| 
(e.g., if the phase angle distribution is peaked near 
±7r/2). Sampling from e~ SG ^\det M(A)\ would then 
mostly obtain relatively atypical configurations (whereas 
Zncw would sample more typical ones), thus causing a 
kind of "overlap problem" : of all reweighting-like meth- 
ods, sampling with Z new causes the smallest fluctuations 
in the associated reweighting factor [45j, at least if one 
does not have any prior knowledge about the phase dis- 
tribution of the fermion determinant or the actual sever- 
ity of the sign problem. Note, there is no good notion of 
"typicality" in the first place if the sign problem is strong, 
since in this case all regions of the integration space are 
equally important in order to capture the fine cancella- 
tions between positive and negative contributions. The 
only thing a sampling method can possibly achieve in 
this case is to make fluctuations in the denominator and 
the numerator of the reweighting formula small (45|. As 
a related point, in no reweighting method (lest ours) can 
the average of the reweighting factor (computed in the 
reweighted ensemble) be an absolutely reliable indicator 
for how well the reweighting method really captures the 
true ensemble (with the sign problem): namely, in the 
case where the reweighting factor is not small for the sole 
reason that the configurations on which one computes the 
average reweighting factor (and which have been sam- 
pled with the reweighted measure) are so untypical that 
they yield a relatively big (and therefore wrong) average 
reweighting factor although the same sampled configura- 
tions yield wrong observable averages otherwise; for this 
reason, one does not have a reliable indication as to when 



the reweighting method fails. 

In terms of computational cost, our method proba- 
bly does rely on full computation of Re det M( A), as the 
sampling proceeds: since there is no apparent way of ex- 
pressing Re det M as a Gaussian (or, at least, exponen- 
tial) bosonic integral (as can be done, e.g., for |detM| 
via pseudofermions [49]), algorithms that are based on 
Hamiltonian dynamics to update the entire lattice at 
once (such as Hybrid Monte Carlo (HMC) [5(|) do not 
seem applicable. Therefore, sampling from |Redet M\ in- 
stead seems to demand local link updates with evaluation 
of the non-local expression Re det M, requiring ~ N 3 op- 
erations with N the dimension of the fermion matrix, for 
each of the N Metropolis tests during one sweep through 
the lattice. By contrast, HMC sampling from |detM| 
needs less than ~ TV 9 / 4 floating point operations to ob- 
tain a new decorrelated configuration. Nevertheless, even 
there det M has to be computed fully for each of the 
sampled, decorrelated configurations. Thus, in the end 
our method seems to be slower by a factor of at least 
~ N (depending on the autocorrelation properties of our 
method), which is a huge disadvantage for sensible lat- 
tice sizes. For small fi, more efficient, but approximate, 
methods exist to determine the phase angle 9 [3 EH, 
and thus Re det M. For example, one can expand detM 
in powers of /x; each coefficient in the expansion is much 
less costly to evaluate than det M itself. 
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